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Abstract 

The note describes the cones in the Euclidean space admitting isotonic metric 
projection with respect to the coordinate-wise ordering. As a consequence it is 
showed that the metric projection onto the isotonic regression cone (the cone defined 
by the general isotonic regression problem) admits a projection which is isotonic with 
respect to the coordinate-wise ordering. 


1. Introduction 

The isotonic regression problem [T| I2|I5|fTf UTl 1131 [IB] and its solution is intimately related 
to the metric projection into a cone of the Euclidean vector space. In fact the isotonic 
regression problem is a special quadratic optimization problem. It is desirable to relate 
the metric projection onto a closed convex set to some order theoretic properties of the 
projection itself, which can facilitate the solution of some problems. When the underlying 
set is a convex cone, then the most natural is to consider the order relation defined by the 
cone itself. This approach gives rise to the notion of the isotonic projection cone, which 
by definition is a cone with the metric projection onto it isotonic with respect to the order 
relation endowed by the cone itself. As we shall see, the two notions of isotonicity, the 
first related to the regression problem and the second to the metric projection, are at the 
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first sight rather different. The fact that the two notions are in fact intimately related 
(this relation constitute the subject of this note) is somewhat accidental and it derives 
from semantical reasons. 

The relation of the two notions is observed and taken advantage in the paper [3|. 
There was exploited the fact that the totally ordered isotonic regression cone is an isotonic 
projection cone too. 

The problem occurs as a particular case of the following more general question: How 
does a closed convex set in the Euclidean space which admits a metric projection isotonic 
with respect to some vectorial ordering on the space look like? 

It turns out, that the problem is strongly related to some lattice-like operations defined 
on the space, and in particular to the Euclidean vector lattice theory. ( 0) When the 
ordering is the coordinate-wise one, the problem goes back in the literature to [31191 ITCTIH31 
fT5] . However, we shall ignore these connections in order to simplify the exposition. Thus, 
the present note, besides proving some new results, has the role to bring together some 
previous results and to present them in a simple unified form. 

2. Preliminaries 

Denote by R m the m-dimensional Euclidean space endowed with the scalar product (•, •) : 
M m x R m —> R, and the Euclidean norm ||.|| and topology this scalar product defines. 

Throughout this note we shall use some standard terms and results from convex ge¬ 
ometry (see e.g. H2D- 

Let K be a convex cone in R m , i. e., a nonempty set with (i) K + K C K and (ii) 
tK C K, V t G R + = [0, Too). The convex cone K is called pointed , if K D (— K) = {0}. 
The cone K is generating if K — K = M m . K is generating if and only if int K ^ 0. 

A closed, pointed generating convex cone is called proper. 

For any x, y G R m , by the equivalence x <k V <=> y—x G K, the convex cone K induces 
an order relation <k in R m , that is, a binary relation, which is reflexive and transitive. 
This order relation is translation invariant in the sense that x <k y implies x + z <k y + z 
for all z G R m , and scale invariant in the sense that x <k y implies tx <k ty for any 
t G R + . Conversely, if ^ is a translation invariant and scale invariant order relation on 
M m , then ^<=<k with K = {x G R m : 0 -< x} a convex cone. If K is pointed, then <k 
is antisymmetric too, that is x <k y and y <k x imply that x = y. Conversely, if the 
translation invariant and scale invariant order relation A on R m is also antisymmetric, 
then the convex cone K = {x G R m : 0 A x} is also pointed. (In fact it would be more 
appropriate to call the reflexive and transitive binary relations preorder relations and the 
reflexive transitive and antisymmetric binary relations partial order relations. However, 
for simplicity of the terminology we decided to call both of them order relations.) 

The set 

K = conejxi,..., x m } := {t l x\ + • • • + t m x m : t l G R+, i — 1, ..., m} 

with xi, ..., x m linearly independent vectors is called a simplicial cone. A simplicial cone 
is closed, pointed and generating. 


2 


The dual of the convex cone K is the set 


K* := {yeR m : (x, y) > 0, V x G K}, 

with (•, •) the standard scalar product in M m . 

The cone K is called self-dual , if K = K*. If K is self-dual, then it is a generating, 
pointed, closed convex cone. 

In all that follows we shall suppose that M m is endowed with a Cartesian reference 
system with the standard unit vectors ei,..., e m . That is, e±, ..., e m is an orthonormal 
system of vectors in the sense that (e*, ef) = 5j, where Sj is the Kronecker symbol. Then, 
ei,..., e m form a basis of the vector space M m . If x G M m , then 

x = x 1 ei + • • • + x m e m 


can be characterized by the ordered m-tuple of real numbers x 1 ,... ,x m , called the coor¬ 
dinates of x with respect the given reference system, and we shall write x = (x 1 ,..., x m ). 
With this notation we have e* = (0,..., 0,1, 0,..., 0), with 1 in the i-th position and 0 
elsewhere. Let x, y G M m , x = (x 1 ,..., x m ), y = (y 1 ,..., y m ), where x\ if are the coor¬ 
dinates of x and y, respectively with respect to the reference system. Then, the scalar 
product of x and y is the sum (x, y) = Y1T= i x% y l • 

The set 

= {x = (x 1 ,..., x m ) G R m : x l > 0, i — 1,. >., m} 

is called the nonnegative orthant of the above introduced Cartesian reference system. A 
direct verification shows that M™ is a self-dual cone. The order relation <r™ induced by 
is called coordinate-wise ordering. 

Besides the non-negative orthant, given a Cartesian reference system, the important 
class of isotonic regression cones should be mentioned. Let w l > 0, i = 1, ...,m be 
weights and (V = {1,..., m}, E ) be a directed graph of vertices V and edges E C V xV 
and without loops (a so called simple directed graph). (If (i,j) € E, then i is called its 
tail, j is called its head.) Then we shall call the set 


K w - 


x G 


x 


< 


x J 


Vvf 


, V(i,j)eE 


the isotonic regression cone defined by the relations E and the weights w\ 

If (V, E) is connected directed simple graph for which each vertex is the tail respective 
a head of at most one edge, then Kf is called weighted monotone cone. In this case K'f 
can be written (after a possible permutation of the standard unit vectors) in the form 


Kf = {xe 


x 


< 


X 


< ... < 


X 


<W‘ 


A hyperplane (through b G M m ) is a set of form 


H(a, b) = {x G M m : (a, x) = (a, b), a f 0}. 


( 1 ) 
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The nonzero vector a in the above formula is called the normal of the hyperplane. 

A hyperplane H(a,b ) determines two closed half-spaces H_(a,b) and H + (a,b) of R m , 
defined by 


H-(a,b) = {16 R m : (a, x) < (a, 6 )}, 

and 

H + (a,b) = {16 R m : (a,x) > ( a,b )}. 

The cone K C M m is called polyhedral if it can be represented in the form 

K = n n k=1 H_(a k ,0). (2) 

If int K ^ 0, and the representation ([2D is irrednndant, then K D H(a,k, 0) is an m — 1- 
dimensional convex cone (k — 1,..., n) and is called a facet of K. 

The simplicial cone and the isotonic regression cones are polyhedral. 


3. Metric projection and isotonic projection sets 

Denote by Pd the projection mapping onto a nonempty closed convex set D C M m , that 
is the mapping which associate to x G R' m the unique nearest point of x in D ( czy 

PdX G D, and ||x — PdX || = inf{||x — y || : y E Dj. 

Given an order relation -< in M m , the closed convex set is said an isotonic projection 
set if from x R y, x, y G M m , it follows Pnx R PdV- 

If -<=<k for some cone K, then the isotonic projection set D is called K-isotonic. 

If the cone K is /T-isotonic then it is called an isotonic projection cone. 

For K = we have PkX = x + where x + is the vector formed with the non-negative 
coordinates of x and 0-s in place of negative coordinates. Since x <k y implies x + <k y + , 
it follows that M ” 1 is an isotonic projection cone. 

We have the following geometric characterization of a closed, generating isotonic pro¬ 
jection cones (Theorem 1 and Corollary 1 in [3]): 

Theorem 1 The closed generating cone K C M m is an isotonic projection cone if and 
only if its dual K* is a simplicial cone in the subspace it spans generated by vectors with 
mutually non-acute angles. 

4. The nonnegative orthant and its isotonic projec¬ 
tion subcones 

If R+ is the nonnegative orthant of a Cartesian system, then we have the following theorem 
(Corollaries 1 and 3 in [ 8 ]): 
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Theorem 2 Let C be a closed convex set with nonempty interior of the coordinate-wise 
ordered Euclidean space R m . Then, the following assertions are equivalent: 

(i) The projection Pc is Wf-isotonic; 

ii 

C = (3) 

where each hyperplane H(ai,bf) is tangent to C and the normals ai are nonzero 
vectors a* = (a \,..., a’ n ) with the properties a!fa\ < 0 whenever k ^ l, igN. 

Example 1 Consider the space R 3 endowed with a Cartesian reference system, and sup¬ 
pose 

Ki = #-((-2,1, 0), 0) n H_(( 1, - 2 , 0), 0) n tf_((0, 0, -1), 0), 

and 

K 2 = H_((- 2,1, 0), 0) n H_(( 1, -2, 0), 0) n H_{( 0,1, -1), 0). 

Then K± and K 2 are simplicial cones in R 3 , x = (1,1, 2) G int K t , i = 1,2. Since 

K\ = cone{(—2,1, 0 ), (1, - 2 , 0 ), ( 0 , 0 , -1)}^ 

and 

I< 2 = cone{(—2,1, 0), (1, -2, 0), (0,1, -1)}\ 

using the main result in we see that K\ is itself an isotonic projection cone, while K 2 
is not. Obviously, K\ and K 2 are both R \-isotonic projection sets. 

Example 2 Let us consider the space R 3 endowed with a Cartesian reference system. 
Consider the vectors 

a \ = (—2,1, 0), a 2 = (1, —2, 0), a 3 = (—2, 0,1), a 4 = (1, 0, —2), a 5 = (0, —2,1), 

° 6 — ( 0 , 1 , — 2 ). 


Then, 

K = n 6 i=1 H_( ai ,0) CR 3 

is by Theorem d an R ^-isotonic projection cone with six facets. 

Indeed, (ai,x) < 0 and (a 2 , x) < 0 imply that x 1 > 0 and x 2 > 0. We can similarly 
show that x G K yields x 3 > 0. Thus, Ii C R 3 . For y = (1,1,1) we have (ai,y) < 0. 
Hence y G int K. It follows that K is a proper cone and the sets H(ai , 0) fl K, i — 1,..., 6 
are different facets of K. 

Next we shall show that the cone in Example [2] is in some sense extremal among the 
R 3 - isotonic subcones in R^_. More precisely we have 
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Theorem 3 If K is a generating cone in R m , then it is W™-isotonic, if and only if it is 
a polyhedral cone of the form 


K = D k< i(H_(a k n,0) D H_(a k i 2 ,0)), k, l G {1,..., m} (4) 

where a k u are nonzero vectors with a kli a! kli < 0 and a J kh = 0 for j ^ { k , l}, i = 1,2. Hence 
K possesses at most m{m — 1) facets. There exists a cone K of the above form with 
exactly m[m — 1) facets. 

Proof. 

The sufficiency is an immediate consequence of Theorem [2j Next we prove the neces¬ 
sity. Assume that K is an R™-isotonic generating cone. By using the same Theorem [2J 
we have that 

K = r ie jH_(ai, 0), (5) 

where J C N is a set of indices and where each hyper plane H(ai, 0) is tangent to K 
and the normals a* are nonzero vectors a* = (a] ,..., a™) with the properties a k a\ < 0 
whenever k ^ l, i G N. 

First of all we introduce the notation 

Aki = {i : a] = 0, j (£ {k , /}}, k, l G {1,..., m}, k <1. 

(In Example [2] A\ 2 = {1,2}, Ai 3 = {3,4}, A 23 = {5,6}.) 

We claim that 

A k i ^ 0, k <1, and U k<i A ki = J■ (6) 

This follows from the structure of the normals a*. Indeed if possesses two non-zero 
components, say a k and a[, k < l, then i G A k i- If it has only one non-zero component, 
say a} with k < m, then i G Ak m , or only one nonzero component a™ then i G Ak m for 
k < m. 

Let us see that 

n iG A k i 0) = H_(a h , 0) n H^(a i2 , 0), (7) 

where 77_(a^, 0) are among those in ([5]) and the case i\ = i 2 is possible. 

Denote by R^ the bidimensional subspace in R m endowed by the fc-th and Z-th axis. 
Then we have the representation 

i a ii 0) = 0)) nljji. 

Now, 0))nMfc/ must be a two dimensional cone in R fci (since K is generating), 

hence it must have one or two extremal rays. That is the intersection can be expressed 
by one or two terms, that is, we can suppose that 1 < card Aki < 2 and ((3) is proved. 
With these remarks we can assert that the formula (J5]) becomes 

K = fl k<i (r\ieAkiH~{ a i, 0)) = n k< i(H_(a kn , 0) D H^(a k i 2 , 0)), (8) 

where a k kll a! m < 0 and a° kli = 0 for j (f {k, /}, i = 1, 2. 
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From formula (JS]) it follows that in the representation (EJ) of K there are at most 
m(m — 1) facets H(a,i, 0) fl K of K. 

Using the construction in Example [2] we can construct a K with exactly m{m — 1) 
facets. To this end, let for k < l clmi be the vector with a kll = —2, a l m = 1 and 
a 3 kl i = 0 for j ^ {k, /}, and dki 2 be the vector with a k kl2 = 1, a! kn = —2 and a kl2 = 0 for 
j {k, /}. We have that the vectors dku are pairwise non-parallel. Putting these vectors in 
the representation (jSJ) we get a proper subcone of R™ which is R™-isotonic and possesses 
exactly m(m — 1) facets. Indeed, we must see that in this case the representation (J8]) 
is irredundant. But this follows from the fact that K C R™ is a polyhedral cone with 
x — (1,1,..., 1) an interior point. Hence some of F^u = H(dku, 0) D K must be facets 
of Ii. Now, from the special feature of dku it follows that the sets F^u are structurally 
equivalent and if one of them is a facet, then all of them are so. 

The proof also implies that K must be a polyhedral cone and if its representation (j5J) 
is irredundant, than the set J must be finite. 

□ 


Remark 1 The representation can be redundant, even if the original one in m is 
irredundant. Indeed, R™ must be of form |2J ) and its irredundant representation contains 
m terms, while its equivalent form m formally contains much more terms. In this case 
(EP can contain terms. But even a minimal “dual" decomposition of is of 

cardinality and hence it contains 2[ m ^-] half-spaces. 


5. Every isotonic regression cone is an M ? ^-isotonic 
projection set 

Projecting y G R m into K given by (JB]) we have to solve the following quadratic mini¬ 
mization problem: 


P K y = argmin 



2 : + a l mx l 


< 0 , 


a kl2 x k + a l m x l <0, k < l 


where the cases a k kl3 = 0, or a l kl3 = 0 are not excluded. 
By using Theorem [2l we see that, from 


(9) 


U V, 

it follows that 

FKU <Rm Pr<V . 

A particular case of this projection problem is equivalent to the so called isotonic 
regression problem [Tll^lISlITl UTlfl^llTB] which can be described as follows: 
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For a given y £ R m and weights Wi > 0, i = 1,..., m 


iso (y) := argmin < ^^wfx 1 — y 1 ) 2 : x l < x\ V(i, j) £ E > , 


i =1 


where (V = {1,..., m}, E) is a directed simple graph. 
Indeed, 


iso (y) = argmin 




< 




w l x- 


\fw~t 


V(i,j)eE 


1 




P K ™(Vwy), 


where for any z £ M m we denote 

\[wz = (vWz 1 ,..., Vw m z m ) 

and 

z _ / z 1 \ 

yhn VvV’ ’ y/w™ ) ’ 

and is the isotonic regression cone defined in Section 2. 

To compare with this with the general projection problem (JU]), we observe that the 
restrictions on x for Pk™ ( y ) are of the form 


ah ad + ah ad < 0 

L J 


X J 


with ah = 1/Vwh and ah = —l/Vwd, [i, j) £ E. Thus we have established the 


Corollary 1 Every isotonic regression cone Kis an Wf-isotonic projection set. 


We further have that 


Proposition 1 The isotonic regression cone Kis an isotonic projection cone if and only 
if in the oriented graph (V, E) does not exist different edges with same tail or different 
edges with same head, that is, edges of form ( i,j ) and ( i , k ) with j k, or edges of form 
{i,j) and ( k,j ) with i k. 

Proof. Assume e. g. that (1,2), (1,3) £ E. Then the corresponding normals are 

0 - 1,2 = (1/Vud, -1/VvP, 0,..., 0) 


and 

ap 3 = (i/vV, 0, -1/VvP, 0,..., 0). 
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Then ai j2 and ai >3 are normals in the irreducible representation of Kg, and (ai >2 , ai )3 ) > 
0. Thus, according to Theorem Q] Kg cannot be an isotonic projection cone. Conversely, 
if there are no vertices with the above type multiplicity property, then the normals in the 
irreducible representation of Kg (which in fact generates —Kg*) form pair-wise non-acute 
angles, hence by the same result Kg is an isotonic projection cone. 

□ 


Corollary 2 If Kg is an isotonic projection cone, then (V, E) splits in disjoint union 
of connected simple graphs with vertices being the tails or heads of at most one edge. 
The single (up to a permutation of the canonical basis) isotonic regression cone Kg, with 
(V, E) a directed connected simple graph, which is also an isotonic projection cone is the 
weighted monotone cone. 
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